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FIG. 6 

( START ) 

I S1_ 

USER OF IMAGE PROCESSING APPARATUS 100 
CONNECTS DIGITAL CAMERA USED FOR IMAGING 
TO EXTERNAL INTERFACE 106. ALTERNATIVELY, 
WHEN CAPTURED IMAGE DATA IS IN A PORTABLE 
MEDIA SUCH AS MO, THEE PORTABLE MEDIA IS 
SET ON MEDIA DRIVE 112. 



S2 



EXTRACTION OF TARGET IMAGE DATA FROM 
DIGITAL CAMERA OR PORTABLE MEDIA SUCH AS 
MO, AND COPIED TO HDD 111, FOR EXAMPLE. 
FURTHER, IMAGE DATA IS SENT TO MEMORY 102. 
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CHECKING ON WHETHER OR NOT EACH PIXEL OF 
FIRST IMAGE IS SATURATED. LET SATURATED 
POSITION BE (Xc, Yc). LET NON-SATURATED 
POSITION BE (Xu, Yu). 



S4 



ASSUMPTION VALUE OF PIXEL IN SATURATED 
POSITION (Xc, Yc) AMONG FIRST IMAGE IS 
OBTAINED USING VALUE CALCULATED FROM 
DIFFERENCE BETWEEN SECOND IMAGE AND 
THIRD IMAGE. SATURATED POSITION IS 
OVERWRITTEN BY ASSUMPTION VALUE. 
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VALUE IS MADE WITHIN THE RANGE OF 0 TO 
255 BY NORMALIZATION 
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OVERWRITTEN FIRST IMAGE IS OUTPUTTED 

( END ) 
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FIG. 7 

S41 

SATURATED PIXEL POSITION (Xc, Yc) AND 
NON-SATURATED PIXEL POSITION (Xu, Yu) 
OF FIRST IMAGE ARE ACQUIRED 



S42 



PIXEL VALUES OF FIRST, SECOND, THIRD IMAGE (Ru1, Gu1, 
Bu1), (Ru2, Gu2, Bu2), (Ru3, Gu3, Bu3) CORRESPONDING TO 
NON-SATURATED PIXEL POSITION (Xu, Yu) OF FIRST 
IMAGE, AND PIXEL VALUES OF FIRST, SECOND, 
THIRD IMAGE (Rc1, Gc1, Bc1), (Rc2, Gc2, Bc2), (Rc3, Gc3, Bc3) 
CORRESPONDING TO THE SATURATION PIXEL POSITION 
(Xc, Yc) OF FIRST IMAGE 
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IS CALCULATED 


Ru3)\ 2 + i 
Ru3) J < 


1 (Gul- 
\ (Gu2- 


Gu3)V 
Gu3)j 


( (Bul- 
{ (Bu2- 


Bu3)\ 2 
Bu3)J 
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2 P (Xu, Yu) 

S = n 

IS CALCULATED, WHERE n IS NUMBER OF NON- 
SATURATED PIXELS IN FIRST IMAGE 
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FIG. 8 
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I S45 

SATURATED PIXEL POSITION (Xc, Yc) IN FIRST IMAGE IS 
ACQUIRED, TEMPORARY COMPENSATION PIXEL VALUES 
(Rcq, Gcq, Bcq) IN EACH POSITION (Xc.Yc) ARE 
CALCULATED ACCORDING TO FOLLOWING EQUATIONS 

Rcq = (Rc2 - Rc3) x S + Rc3 

Gcq = (Gc2 - Gc3) x S + Gc3 

Bcq = (Bc2 - Bc3) X S + Bc3 
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S51 


MAXIMUM:DMAX IS CALCULATED ABOUT ALL PIXELS OF 
PIXEL VALUES (Ru, Gu, Bu) FOR NON-SATURATED PIXEL 
AND TEMPORARY COMPENSATION PIXEL VALUES (Rcq, 
Gcq, Bcq) FOR SATURATED PIXEL (Xc, Yc) IN FIRST IMAGE 
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NORMALIZATION PROCESS 
COMPENSATION PIXEL VALUE (Ruf, Guf, Buf) IN 
NON-SATURATED PIXEL POSITION (Xu, Yu) AND 
COMPENSATION PIXEL VALUES (Rcf, Gcf, Bcf) IN 
SATURATED PIXEL POSITION (Xc, Yc) ARE CALCULATED 



(1) IN THE CASE OF 
NON-SATURATED 
PIXEL (Xu, Yu), 
Ruf = (Ru / Dmax) x 255 
Guf = (Gu / Dmax) x 255 
Buf = (Bu / Dmax) X 255 



L 



(1) IN THE CASE OF 

SATURATED 

PIXEL (Xc, Yc), 
Rcf = (Rcq / Dmax) x 255 
Gcf = (Gcq / Dmax) x 255 
Bcf = (Bcq / Dmax) X 255 
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FIG. 10 



INTENSITY OF 
EMITTED LIGHT 



HIGH 



NORMAL SETUP 



LOW 




FIRST THIRD 
THIRD IMAGE SECOND IMAGE 
IMAGE IMAGE 



CAPTURED 
IMAGE 
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IMAGED WITHOUT FLASH LIGHT 

i 



IMAGE h CAPTURED WITHOUT 
FLASH LIGHT IS STORED IN 
MEMORY 



IMAGED WITH F LASH LIGHT 

i 



IMAGE I 2 CAPTURED WITH FLj^SH 
LIGHT IS STORED IN MEMORY 



X 



IMAGED WITHOUT FLASH LIGHT 

I 



IMAGE I 3 CAPTURED WITHOUT 
FLASH LIGHT IS STORED IN 

MEMORY 
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MOVING PORTION DETECTION 



S101 

S102 

S103 
S104 
S105 

S106 
S107 



S108, 

PRESENCE OF 
MOVING PORTION ?^ 




FIG. 1 2 
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WHITE BALANCE 
ADJUSTMENT 
PROCESS BASED 
ON MULTIPLE 
IMAGE DATA 



I 
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WHITE BALANCE ADJUSTMENT 
PROCESS BASED ON MULTIPLE 
IMAGE DATA 



PIXEL VALUE COMPENSATION 
OF MOVING PORTION IN WB 
ADJUSTMENT IMAGE R 
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WHITE BALANCE 
ADJUSTMENT OF 
IMAGE I 2 CAPTURED 
WITH FLASH LIGHT IS 
CARRIED OUT TO 
GENERATE WB 
ADJUSTMENT IMAGE R 
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FIG. 1 3 



(START OF WHITE BALANCE 
ADJUSTMENT PROCESS BASED 
ON MULTIPLE IMAGE DATA 

S201 



DIFFERENCE IMAGE DATA F = I 2 - Ii IS GENERATED 




S202 



WHITE BALANCE (WB) ADJUSTMENT IS PERFORMED 
BASED ON THE PARAMETER IN WHICH DIFFERENCE 
IMAGE DATA F IS SET UP ACCORDING TO FLASH 
LIGHT, FURTHER, COMPENSATION IMAGE F* 
SUBJECTED TO LEVEL ADJUSTMENT IS GENERATED 



S203 

BASED ON PARAMETER IN WHICH IMAGE DATA I, 
CAPTURED WITHOUT FLASH LIGHT IS SET UP 



ACCORDING TO AMBIENT LIGHT, WHITE BALANCE 
(WB) ADJUSTMENT IS PERFORMED TO GENERATE 
COMPENSATION IMAGE l{ 
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S204 


WHITE BALANCE (WB) 
R = I 1 '+ F' IS GENERA! 


ADJUSTMENT IMAGE 
"ED 



(END OF WHITE BALANCE 
ADJUSTMENT PROCESS BASED 
ON PLURAL IMAGE DATA 
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START OF PIXEL VALUE COMPENSATION OF 
MOVING PORTION IN WB ADJUSTMENT IMAGE RD 



VALUE k' OF PERIPHERAL PIXEL 651 
OF MOVING PORTION IS COMPUTED 



BASED ON k' OF SAMPLE POINT, 
RBF IS CONSTRUCTED 



S301 



S302 



FIRST COLOR CONVERSION IS 
PERFORMED IN QUEST OF k' OF THE 
PIXEL OF MOVING PORTION, AND IT 
ASKS FOR FIRST COMPENSATION 
IMAGE R' 
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RATIO (ar, ag, ab) OF EACH COLOR 
COMPONENT OF INNER CIRCUMFERENCE 
PIXEL 650 OF MOVING PORTION TO 
ADJACENT PIXEL IS COMPUTED FOR 
COMPENSATION IMAGE R' 
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f 


RBF IS BUILT BASED ON (Qfr, org, ab) 
IN SAMPLE POINT 


> 


f 



S305 



(ar, ag, ab)OF PIXEL OF MOVING 
PORTION IS OBTAINED, AND SECOND 
COLOR CONVERSION IS PERFORMED 
SO AS TO OBTAIN SECOND 
COMPENSATION IMAGE R" 
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END OF PIXEL VALUE COMPENSATION OF 
MOVING PORTION IN WB ADJUSTMENT IMAGE R 
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FIG. 1 9 



(START OF WHITE BALANCE ^\ 
ADJUSTMENT PROCESSING BASED ) 
ON PLURAL IMAGE DATA J 

i S401 



DIFFERENCE IMAGE DATA F = I 2 - Ii IS GENERATED 



S402 



BASED ON PARAMETER IN WHICH DIFFERENCE 
IMAGE DATA F IS SET UP ACCORDING TO AMBIENT 



LIGHT IS SUBJECTED TO WHITE BALANCE (WB) 
ADJUSTMENT TO GENERATE COMPENSATION 
IMAGE F' 
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S403 


FIRST WHITE BALANCE (WB) ADJUSTMENT IMAGE 
Ri = h + F' IS GENERATED 


> 


, S404 



FIRST WHITE BALANCE (WB) ADJUSTMENT IMAGE 
Rt IS FURTHER SUBJECTED TO WHITE BALANCE 
(WB) ADJUSTMENT TO GENERATE SECOND WHITE 
BALANCE (ADJUSTMENT) IMAGE R 2 



(END OF WHITE BALANCE 
ADJUSTMENT PROCESSING BASED 
ON PLURAL IMAGE DATA 
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